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INPUT IMAGE 
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IMAGE PROCESSING AND SEGMENTATION 
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TEXT LAYOUT ANALYSIS 
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LINE ART ANALYSIS 
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CONSTRUCTION OF ALTERNATIVE GRAPH 
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EXPORT TO STRUCTURED GRAPHIC EDITOR 
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PRESENTATION TO USER FOR EDITING 
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FIG. 7 
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INPUT BINARY IMAGE ARRAY 
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DETECT AND REMOVE HORIZONTAL LINES FROM BINARY IMAGE ARRAY 
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OBTAIN ARRAY B' 
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DEFINE STABLE GROUPS OF CONNECTED COMPONENTS IN B' 



IF COMPONENT MINIMUM HEIGHT, THEN DEFINE AS TEXT 
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FORM NEIGHBOR LINK AMONG TEXT CONNECTED COMPONENTS V~~ 132 



FORM TEXT-LINES BY HORIZONTAL GROUPING OF CONNECTED COMPONENTS \ — 134 



ACCUMULATE BASIC TEXT-LINE ATTRIBUTES, WITHIN EACH TEXT-LINE 
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FIG. 8A 
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DETECT BULLETS 



138 



FORM TEXT-LINE-VERTICAL-LINKS BETWEEN DISTINCT TEXT-LINES 



FORM TEXT-REGIONS BY VERTICAL GROUPINGS OF TEXT-LINES 



COMPUTE TEXT REGION BOUNDING BOX ATTRIBUTES 



DERIVE FURTHER ATTRIBUTES FROM THE REGION LINES 



DEFINE REGION JUSTIFICATION AND INDENTATION PROPERTIES 
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INPUT SET OF STROKE-FRAGMENT OBJECTS TYPICALLY REPRESENT ED AS CHAIN-CODE CURVES^ 

1 



FORM CLOSED STROKE PATH OBJECTS 



I 



164 



REMOVE FROM THE CANDIDATE SET OF STROKE FRAGMENTS ALL STROKE FRAGMENTS THAT 
PARTICIPATE IN THE FORMATION OF CLOSED STROKE PATH OBJECTS RETURNED IN 164 
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INSTANTIATE DATA STRUCTURES, CALLED ALIGNMENT LINKS, FOR EVERY PAIR OF ENDS OF 
STROKE FRAGMENT CURVES THAT FORM A SPATIAL CONFIGURATION OF ALIGNMENT 



COMPUTATIONALLY SCRUTINIZE THE RESULTING ALIGNMENT LINKS, AND SELECT FOR 
FURTHER PROCESSING ONLY THOSE THAT ARE CLEAR AND UNAMBIGUOUS 



I 



COLLECT ALL TRANSITIVE CLOSURES OF STROKE FRAGMENTS JOINED BY SURVIVING 
ALIGNMENT LINKS. CALL THESE ALIGNMENT CHAINS. 



I 



FOR EACH ALIGNMENT CHAIN, FIT A PARAMETRIC CURVE, E.G., A STRAIGHT LINE, TO THE SET 
OF STROKE FRAGMENTS FORMING A CHAIN. RECORD THESE AS ALTERNATIVE 
REPRESENTATIONS OF SKETCHED CURVES REPRESENTED BY THE ALIGNMENT CHAINS 
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INSTANTIATE DATA STRUCTURES, CALLED CORNER LINKS, FOR EVERY PAIR OF ENDS OF 
ALIGNMENT CHAINS THAT FORM A SPATIAL CONFIGURATION OF FORMING A CORNER 



* 

COMPUTATIONALLY SCRUTINIZE THE RESULTING CORNER LINKS, AND SELECT FOR FURTHER 
PROCESSING ONLY THOSE THAT ARE CLEAR AND UNAMBIGUOUS 



f 

COLLECT ALL TRANSITIVE CLOSURES OF STROKE FRAGMENTS JOINED BY SURVIVING 
CORNER LINKS. CALL THESE OPEN CURVILINEAR PATHS. 



t 

APPLY SYMBOL RECOGNITION PROCEDURES TO THE STROKE FRAGMENTS REMAINING AFTER 
STEP 166. FOR EACH SYMBOL RECOGNIZED, RECORD AS ALTERNATIVE INTERPRETATIONS 
THE RECOGNIZED SYMBOL AND THE SUBSET OF STROKE FRAGMENTS THAT MATCHES THE 
CURVILINEAR FEATURES OF THE SYMBOL 



t 

FOR EACH CLOSED STROKE PATH OBJECTS DELIVERED IN STEP 164, EXTRACT THE SUBSET OF 
STROKE FRAGMENTS THAT PARTICIPATE IN THE PATH, AND PERFORM STEPS 168 THROUGH 
174. RECORD IN AN INTERMEDIATE DATA STRUCTURE THE GROUPS OF STROKE FRAGMENTS 
FORMING THE RELATIVELY STRAIGHT SIDES OF THE CLOSED OBJECTS. 



I ; 

FOR EACH CLOSED STROKE PATH OBJECTS DELIVERED IN STEP 162 PERFORM A MODEL-BASED 
SHAPE RECOGNITION PROCEDURE. RECORD RECOGNIZED SHAPES AS 
ALTERNATIVE INTERPRETATIONS. 
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INPUT TO THE PROCEDURE LISTS OF TEXT OBJECTS, OPEN CURVILINEAR PATH OBJECTS, 
CLOSED CURVILINEAR PATH OBJECTS, AND SYMBOL OBJECTS 



FOR EACH CLOSED CURVILINEAR PATH, AN INTERMEDIATE DATA STRUCTURE (CALL THIS A 
B-STRUCT) IS FORMED AND THE LIST OF ALTERNATIVE INTERPRETATIONS OF THIS 
CLOSED PATH ARE ENTERED 



t 

FOR EACH OPEN CURVILINEAR PATH, FORM AN INTERMEDIATE B-STRUCT STRUCTURE, AND 
PLACE THE LIST OF ALTERNATIVE INTERPRETATIONS OF THIS OPEN PATH IN THE B-STRUCT 



t 

FOR EACH TEXT GROUP, FORM AN INTERMEDIATE B-STRUCT STRUCTURE, AND PLACE THE LIST 
OF ALTERNATIVE INTERPRETATIONS OF THIS TEXT IN THE B-STRUCT 



* 

DETERMINE CONTAINMENT RELATIONS. FOR EACH B-STRUCT REPRESENTING A CLOSED 

CURVILINEAR PATH, TEST ALL OTHER B-STRUCTS AND DETERMINE WHETHER THE LATTER 
OBJECT IS CONTAINED WITHIN THE BOUNDS OF THE CLOSED CURVILINEAR PATH. IF SO, 

DENOTE THIS RELATION. 

I 

SELECT ALL B-STRUCTS FOR WHICH THE CONTAINED-BY SLOT IS EMPTY. FOR EACH SUCH 
B-STRUCT, CREATE A NODE FOR THE ALTERNATIVE GRAPH OF TYPE ALTERNATIVE. 
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FOR EACH ALTERNATIVE NODE: 



204 



TRAVERSE THE COLLECTION OF OBJECTS RELATED TO THE ALTERNATIVE NODE'S B-STRUCT. 
AT EACH B-STRUCT ENCOUNTERED, COUNT THE NUMBER OF ALTERNATIVE INTERPRETATIONS. 
CALL THE MAXIMUM OF THIS COUNT OVER ALL THE DESCENDANTS OF THE 
ALTERNATIVE NODE, N. 



CREATE N NODES OF TYPE, CHOICE, AND LINK THESE TO THE ALTERNATIVE NODE 



2 



FOR EACH CHOICE BRANCH OF THE ALTERNATIVE NODE, PROCEED TO CONSTRUCT A TREE OF 
DESCENDANT AND NESTED OBJECTS BY FOLLOWING LINKS TO B-STRUCT STRUCTURES 
THROUGH CONTAINS SLOTS AND ALT-INTERPRETATION-LIST SLOTS 
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START A POWERPOINT APPLICATION INSTANCE USING THE PUBLISHED COM API 
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EXAMINE THE LIST OF ALTERNATIVE NODES IN THE ALTERNATIVE GRAPH AND DETERMINE THE 
MAXIMUM NUMBER OF CHOICE NODES, N. 



USING THE INTERACTION OBJECT WITH THE POWERPOINT APPLICATION, CREATE N NEW 

POWERPOINT SLIDES. 



FOR EACH ALTERNATIVE NODE OF THE ALTERNATIVE GRAPH, RECURSIVELY INSTANTIATE CHILD 
OBJECTS BY SENDING THE SPECIFICATIONS OF THE OBJECT TO THE RUNNING 
POWERPOINT APPLICATION. FOR EVERY TEXT OR GRAPHIC OBJECT THUS INSTANTIATED, 
THE POWERPOINT APPLICATION RETURNS AN OBJECT IDENTIFIER. 
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WHEN A NODE OF TYPE GROUP IS ENCOUNTERED, RECURSIVELY INSTANTIATE OBJECTS 
LISTED IN THE GROUP'S MEMBER LIST. COLLECT IDENTITIES OF ALL INSTANTIATED OBJECTS 
AND INSTANTIATE A POWERPOINT GROUP OBJECT LISTING THESE AS MEMBERS 
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